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(57) Abstract: In a near-in stantaneou sly adaptive joint-detection CDMA-based transceiver used for wireless video telephony a 
method for transmission of a multimedia signal is described, the method comprising: providing a transmitter operable to transmit 
in a plurality of modulation modes varying in bit rate and error resilience between a highest bit rate, lowest error resilience mode 
and a lowest bit rate, highest error resilience mode; obtaining a channel quality measure for current transmission; and switching to a 
more or less error resilient modulation mode each time the channel quality measure respectively degrades or improves by a defined 
amount, whereby multimedia signal quality varies smoothly with varying channel quality of the transmission medium. 
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ADAPTIVE JOINT-DETECTION COMA VIDEO TRANSCEIVER 



4 1 Background of the Invention 

s The invention relates to burst-by-burst adaptive joint-detection Code Division Multiple Access (CDMA) 

6 based transmission of multimedia signals, such as interactive video or audio, speech etc. 

7 In contrast to the bursuby-burst reconfigurable CDMA multimedia transceivers described in this doc- 

8 ument, the term statically reconfigurable found in this context in the literature refers to multimedia 

9 transceivers that cannot be near-instantaneously reconfigured. More explicitly, the previously proposed 
to statically reconfigurable video transceivers were reconfigured on a long-term basis under the base sta- 
n tion's control, invoking for example in the central cell region - where benign channel conditions prevail 
u - a less robust, but high-throughput modulation mode, such as 4 bit/symbol Quadrature Amplitude Mod- 
»3 ulation (16QAM), which was capable of transmitting a quadruple number of bits and hence ensured a 
u better video quality. By contrast, a robust, but low-throughput modulation mode, such as 1 bit/symbol 
is Binary Phase Shift Keying (BPSK) can be employed near the edge of the propagation cell, where hostile 
i« propagation conditions prevail. This prevented a premature hand-over at the cost of a reduced video 
ir quality. 

is The philosophy of the fixed, but programable-rate proprietary video codecs and statically reconfigurable 

19 multi-mode video transceivers presented by Streit et al for example in References [1] was that irrespec- 

» live of the video motion activity experienced, the specially designed video codecs generated a constant 

ii number of bits per video frame. For example, for videophony over the second-generation Global System 

22 of Mobile Communications known as the GSM system at 13 kbps and assuming a video scanning rate of 

n 10 frames/s, 1300 bits per video frame have to be generated. Specifically, two families of video codecs 

24 were designed, one refraining from using error-sensitive run-length coding techniques and exhibiting the 

2s highest possible error resilience and another, aiming for the highest possible compression ratio. This 

28 fixed-rate approach had the advantage of requiring no adaptive feedback controlled bitrate fluctuation 

27 smoothing buffering and hence exhibited no objectionable video latency or delay. Furthermore, these 

28 video codecs were amenable to video telephony over fixed-rate second-generation mobile radio systems, 

29 such as the GSM. 

m The fixed bitrate of the above proprietary video codecs is in contrast to existing standard video codecs, 
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3t such as the Motion Pictures Expert Group codecs known as MPEG I and MPEG2 or the ITU's H.263 

32 codec, where the time-variant video motion activity and the variable-length coding techniques employed 

33 result in a time-variant bitrate fluctuation and a near-constant perceptual video quality. This time-variant 

34 bitrate fluctuation can be mitigated by employing adaptive feed-back controlled buffering, which po- 

35 tentially increases the latency or delay of the codec and hence it is often objectionable for example in 
3B interactive videophony. The schemes presented by Streit et ai in References [I ] result in slightly variable 
37 video quality at a constant bitrate, while refraining from employing buffering, which again, would result 
3« in latency in interactive videophony. A range of techniques, which can be invoked, in order to render the 
39 family of variable- length coded, highly bandwidth-efficient, but potentially error-sensitive class of stan- 
« dard video codecs, such as the H.263 arrangement, amenable to error-resilient, low-latency interactive 
4i wireless multimode videophony was summarised in [2]. The adaptive video rate control and packetisa- 
43 tion algorithm of [2] generates the required number of bits for the burst-by-burst adaptive transceiver, 

43 depending the on the capacity of the current packet, as determined by the current modem mode. Fur- 

44 ther error-resilient H.263-based schemes were contrived for example by FUrber, Steinbach and Girod 
4$ at Erlangen University [3], while Sadka, Eryurtlu and Kondoz [4] from Surrey University proposed a 
4s range of improvements to the H.263 scheme. Following the above portrayal of the prior art in both video 
4r compression and statically reconfigurable narroband modulation, let us now consider the philosophy of 

48 wideband burst-by-burst adaptive quadrature amplitude modulation (AQAM) in more depth. 

49 In burst-by-burst adaptive modulation a higher-order modulation scheme is invoked, when the channel 
w is favourable, in order to increase the system's bits per symbol capacity and conversely, a more robust 
si lower order modulation scheme is employed, when the channel exhibits inferior channel quality, in order 
si to improve the mean Bit Error Ratio (BER) performance. A practical scenario, where adaptive modular 
a tion can be applied is, when a reliable, low-delay feedback path is created between the transmitter and 
54 receiver, for example by superimposing the estimated channel quality perceived by the receiver on the 
5s reverse-direction messages of a duplex interactive channel. The transmitter then adjusts its modem mode 
5« according to this perceived channel quality. 

57 Recent developments in adaptive modulation over a narrow-band channel environment have been pi- 

M oneered by Webb and Steele [5], where the modulation adaptation was utilized in a Digital European 

59 Cordless Telephone - like (DECT) system. The concept of variable rate adaptive modulation was also 

so advanced by Sampei et ai [6], showing promising advantages, when compared to fixed modulation in 

si terms of spectral efficiency, BER performance and robustness against channel delay spread. In another 

82 paper, the numerical upper bound performance of adaptive modulation in a slow Rayleigh flat-fading 

83 channel was evaluated by Torrance et al[l) and subsequently, the optimization of the switching threshold 
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64 levels using Powell minimization was used in order to achieve a targeted performance {8. 9]. In addition, 

w adaptive modulation was also studied in conjunction with channel coding and power control techniques 

66 by Matsuoka et al [6] as well as Goldsmith et al.[\Q]. 

67 In the narrow-band channel environment, the quality of the channel was determined by the short term 

68 Signal to Noise Ratio (SNR) of the received burst, which was then used as a criterion in order to choose 

69 the appropriate modulation mode for the transmitter, based on a list of switching threshold levels, l n [5, 9). 
to However, in a wideband environment, this criterion is not an accurate measure forjudging the quality of 

71 the channel, where the existence of multi-path components produces not only power attenuation of the 

72 transmission burst, but also intersymbol interference. Subsequently, a new criterion has to be defined to 

73 estimate the wideband channel quality in order to choose the appropriate modulation scheme. 

74 2 Summary of the Invention 

?s Particular and preferred aspects of the invention are set out in the accompanying independent and depen- 

76 dent claims. Features of the dependent claims may be combined with those of the independent claims as 

77 appropriate and used in combinations other than those explicitly set out in the claims. 

76 The performance benefits of burst-by-burst adaptive modulation assisted CDMA are described, employ- 

79 ing a higher-order modulation mode in transmission bursts, when the instantaneous channel quality is 

ao favourable, ie when the received signal is unimpaired by co-channel interferes. This procedure is em- 

8i ployed, in order to increase the system's bits per symbol (BPS) capacity and conversely, invoking a more 

62 robust, lower order modulation mode, when the channel exhibits inferior channel quality. Therefore the 

eo associated bit rate will be time-variant 

« It is shown that due to the described adaptive modem mode switching regime a seamless multimedia 

88 source-signal representation quality • such as video or audio quality - versus channel quality relation- 

ee ship can be established, resulting in a near-unimpaired multimedia source-signal quality right across 

a? the operating channel Signal-to-Noise Ratio (SNR) range. The main advantage of the described tech- 

66 nique is that irrespective of the prevailing channel conditions, the transceiver achieves always the best 

69 possible source-signal representation quality - such as video or audio quality - by automatically adjust- 

90 ing the achievable bitrate and the associated multimedia source-signal representation quality in order to 

91 match the channel quality experienced. This can achieved on a near-instantaneous basis under given 
9a propagation conditions in order to cater for the effects of path-loss, fast-fading, slow-fading, dispersion, 

93 co-channel interference, etc. Furthermore, when a mobile is roaming in a hostile out-doors - or even 

94 hilly terrain - propagation environment, typically low-order, low-rate modem modes are invoked, while 
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9$ in benign indoor environments predominantly the high-rate, high source-signal representation quality 

96 modes are employed, 

w 3 Brief Description of the Drawings 

99 For a better understanding of the invention and to show how the same may be carried into effect reference 

99 is now made by way of example to the accompanying drawings, in which: 

too List of Figures 

»ot 1 Signalling scenarios in adaptive modems 19 

\y 2 Reconfigurable transceiver schematic 20 

.<» 3 Transmission burst structure of the FMA1 spread speech/data mode 2 of the FRAMES 

w proposal(ll] 20 

io5 4 Normalized channel impulse response for the COST 207 seven-path Bad Urban channel. 2 1 

joe 5 BER versus channel SNR 4QAM performance using BCH coded 13.7Kbps video, com- 

107 paring the performance of matched filtering and joint detection for 2-8 users 21 

109 6 BER versus channel SNR 4QAM performance using turbo-coded 1 1.1Kbps video, com- 

to9 paring the performance of matched filtering and joint detection for 2-8 users 22 

no 7 Video packet loss ratio versus channel SNR for the turbo-coded 11.1 Kbps video stream, 

m comparing the performance of matched filtering and joint detection for 2-8 users 22 

iu 8 Video packet loss ratio (PLR) and feedback error ratio (FBER) versus channel SNR for 

.11 j the three modulation schemes ofthe2-user multi-mode system using joint detection. . . 23 

iu 9 Decoded video quality (PSNR) versus channel SNR for the modulation modes of BPSK, 

us 4QAM and 16QAM supporting 2-users with the aid of joint detection. These results 

us were recorded for the Miss-America video sequence at SQCIF resolution (128x96 pels). 23 

H7 10 Decoded video quality (PSNR) versus video packet loss ratio for the modulation modes 

us of BPSK, 4QAM and 16QAM, supporting 2-users with the aid of joint detection. The 

M9 results were recorded for the Miss-America video sequence at SQCIF resolution (128x96 

im pels) 24 

ui 1 1 Example of modem mode switching in a dynamically reconfigured burst-by-burst mo- 

122 dem in operation, where the modulation mode switching is based upon the S1NR estimate 

123 at the output of the joint-detector. 24 
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«24 1 2 PDF of the various adaptive modem modes versus channel SNR 25 

123 1 3 Throughput bitrate versus channel SNR comparison of the three fixed modulation modes 
■26 (BPSK, 4QAM. 16QAM) and the adaptive burst-by-burst modem (AQAM), both sup- 

»w porting 2 users with the aid of joint detection 25 

128 14 Average decoded video quality (PSNR) versus channel SNR comparison of the fixed 

129 modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 
t» dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

for the Miss-America video sequence at SQCIF resolution (128x96 pels) 26 

•32 15 Video packet loss ratio (PLR) versus channel SNR for the three modulation schemes of 
133 the multi-mode system, compared to the burst-by-burst adaptive modem. Both systems 

substain 2-users using joint detection 26 

16 Decoded video quality (PSNR) versus video packet loss ratio comparison of the fixed 
modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 
dem. Both supporting 2-users with the aid of joint detection. These results were recorded 
for the Miss- America video sequence at SQCEF resolution (128x96 pels) 27 
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139 3.1 State-of-the-art 

»4o Burst-by-burst adaptive quadrature amplitude modulation (AQAM) was contrived by Steele and Webb [5], 
m in order for the transceiver to cope with the time-variant channel quality of narrowband fading channels. 
u2 Further related research was conducted at the University of Osaka by Sampei and his colleagues, investi- 
i« gating variable coding rate concatenated coded schemes [6], at the University of Stanford by Goldsmith 
144 and her team, studying the effects of variable-rate, variable-power arrangements [10] and at Southamp- 
.45 ton University in the UK t investigating a variety of practical aspects of AQAM [12, 13J. The channel's 
»4« quality is estimated on a burst-by-burst basis and the most appropriate modulation mode is selected in or- 
U7 der to maintain the required target bit error rate (BER) performance, whilst maximizing the system's Bit 
i4« Per Symbol (BPS) throughput. Using this reconfiguration regime the distribution of channel errors be- 
49 comes typically less bursty, than in conjunction with non-adaptive modems, which potentially increases 
.J* the channel coding gains. Furthermore, the soft-decision channel codec metrics can be also invoked in 
i5i estimating the instantaneous channel quality, irrespective of the type of channel impairments, 
isa A range of coded AQAM schemes were analysed by Matsuoka et al [6], Lau et al [14] and Gold- 
.53 smith et al [10]. For data transmission systems, which do not necessarily require a low transmission 
154 delay, variable-throughput adaptive schemes can be devised, which operate efficiently in conjunction 
iss with powerful error correction codecs, such as long block length turbo codes. However, the acceptable 
im turbo interleaving delay is rather low in the context of low-delay interactive speech. Video communica- 
157 tions systems typically require a higher bitrate than speech systems and hence they can afford a higher 
iss interleaving delay. 

159 The above principles - which were typically investigated in the context of narrowband modems - were 
„iw further advanced in conjunction with wideband modems, employing powerful block turbo coded wide- 
i«i band Decision Feedback Equaliser (DFE) assisted AQAM transceivers [15]. A neural-network Radial 
lea Basis Function (RBF) DFE based AQAM modem design was proposed in [16], where the RBF DFE 
isa provided the channel quality estimates for the modem mode switching regime. This modem was capa- 
164 ble of removing the residual BER of conventional DFEs, when linearly non-separable received phasor 
ies constellations were encountered. 

tee The above burst-by-burst adaptive principles can also be extended to Adaptive Orthogonal Frequency 
167 Division Multiplexing (AOFDM) schemes [17]. The associated AQAM principles were invoked in the 
•bb context of parallel AOFDM modems also by Czylwik et al [18], Fischer [19] and Chow et al [20]. 
tea Our main contribution is that upon invoking the technique advocated - irrespective of the channel con- 
i7o ditions experienced - the transceiver achieves always the best possible video quality by automatically 
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iti adjusting the achievable bitrate and the associated video quality in order to match the channel quality ex- 

»72 perienced. This is achieved on a near-instantaneous basis under given propagation conditions in order to 

i73 cater for the effects of path-toss, fast-fading, slow-fading, dispersion, co-channel interference, etc. Fur- 

m thermore, when the mobile is roaming in a hostile outdoor propagation environment, typically low-order, 

t7s low-rate modem modes are invoked, while in benign indoor environments predominantly the high-rate, 

178 high source-signal representation quality modes are employed. 

in 3.2 ACDMA Signalling Scenarios 

i78 ACDMA transmission parameter adaptation is an action of the transmitter in response to time-varying 

»7« channel conditions. It is only suitable for duplex communication between two stations, since the trans- 

leo mission parameter adaptation relies on some form of channel estimation and signalling. In order to 

iei efficiently react to the changes in channel quality, the following steps have to be taken: 

in • Channel quality estimation: In order to appropriately select the transmission parameters to be 

i83 employed for the next transmission, a reliable prediction of the channel quality during the next 

»84 active transmit timeslot is necessary. 

las • Choice of the appropriate parameters for the next transmission: Based on the prediction of the 

las expected channel conditions during the next timeslot, the transmitter has to select the appropriate 

187 modulation schemes for the subcarriers. 

iB8 • Signalling or blind detection of the employed parameters: The receiver has to be informed, as 

189 to which set of demodulator parameters to employ for the received packet This information can 

i» either be conveyed within the packet, at the cost of loss of useful data bandwidth, or the receiver 

191 can attempt to estimate the parameters employed at the transmitter by means of blind detection 

i9i mechanisms. 

193 Depending on the channel characteristics, these operations can be performed at either of the duplex 

194 stations, as shown in Figures 1(a), 1(b) and 1(c), If the channel is reciprocal, then the channel quality 

195 estimation for each link can be extracted from the reverse link, and we refer to this regime as open- 
198 loop adaptation. In this case, the transmitter needs to communicate the transmission parameter set to 

197 the receiver (Figure 1(a)), or the receiver can attempt blind detection of the transmission parameters 

198 employed (Figure 1(c)). 

i»9 If the channel is not reciprocal, then the channel quality estimation has to be performed at the receiver 

200 of the link. In this case, the channel quality measure or the set of requested transmission parameters is 



7 



WO 00/72496 



PCT/GB00/01889 



201 communicated to the transmitter in the reverse link (Figure 1(b)). This mode is referred to as closed-loop 

202 adaptation. 

2oo 3.3 Video Transceiver 

204 The schematic of the whole system is depicted in Figure 2. The multimedia source signal generated by 

2os the video encoder of Figure 2 is assembled into transmission packets consulting a CDMA transmission 

2oe burst and the bits may be additionally mapped by the Mapper of Figure 2 to n number of different 

20? Forward Error Correction (FEC) protection classes. These bits are then convenveyed to the optional 

208 Time Division Multiplex (TDMA)/ Time Division Duplex (TDD) scheme of Figure 2, before they are 

209 assigned to the AQAM/ACDMA modem seen in Figure 2. 

. 210 Again, the philosophy of the proposed burst-by-burst adaptive joint detection CDMA scheme is that the 

'm signal to interference plus noise ratio (SINR) at the output of the multi-user receiver is used in order to 

212 estimate the instantaneous channel quality. In one of its possible embodiments the receiver then decides 

213 on the transmitter's mode to be used during the next transmission burst on the basis of the received signal 
2i« quality and the receiver's perception of the channel quality is signalled to the remote transmitter, in order 
2u to allow it to satisfy the receiver's integrity requirement. 

2iB In this study we transmitted 176x144 pixel Quarter Common Intermediate Format (QCEF) and 128x96 

217 pixel Sub-QCIF (SQCIF) video sequences at 10 frames/s using a reconfigurable Time Division Multiple 

2iB Access / Code Division Multiple Access (TDMA / CDMA) transceiver, which can be configured as a I, 

219 2 or 4 bit/symbol scheme shown in Figure 2. The H.263 video codec exhibits an impressive compression 

220 ratio, although this is achieved at the cost of a high vulnerability to transmission errors, since a run-length 

221 coded stream is rendered undecodable by a single bit error. In order to mitigate this problem, when the 
2i channel codec protecting the video stream is overwhelmed by the transmission errors, we refrain from 
223 decoding the corrupted video packet in order to prevent error propagation through the reconstructed video 
a* frame buffer [2]. We found that it was more beneficial in video quality terms, if these corrupted video 
sis packets were dropped and the reconstructed frame buffer was not updated, until the next video packet 
228 replenishing the specific video frame area was received. The associated video performance degradation 

227 was found perceptually unobjectionable for packet dropping- or transmission frame error rates (FER) 

228 below about 5%. These packet dropping events were signalled to the remote decoder by superimposing 

229 a strongly protected one-bit packet acknowledgement flag on the reverse-direction packet, as outlined 

230 in [2]. Bose-Chaudhuri-Hocquenghem (BCH) and turbo error correction codes were used and again, 

231 the CDMA transceiver was capable of transmitting 1, 2 and 4 bits per symbol, where each symbol was 

232 spread using a low spreading factor (SF) of 16, as seen in Table 1. 
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Parameter 




Multiple access 


TD MA/CDMA 


Channel type 


COST 207 Bad Urban 


Number of paths in channel 


7 


Normalised Doppler frequency 


3.7 xl0~ 5 


CDMA spreading factor 


16 


Spreading sequence 


Random 


Frame duration 


4.615 ms 


Burst duration 


577 //s 


Joint detection CDMA receiver 


Whitening matched filter (WMF) or Minimum 
mean square error block decision feedback 
equalizer (MMSE-BDFE) 


No. of Slots/Frame 


8 


TDMA frame length 


4.615ms 


TDMA slot length 


577jiS 


TDMA slots/Video packet 


3 


Chip Periods/TDMA slot 


1250 


Data Symbols/TDMA slot 


68 


User Data Symbol Rate (kBd) 


14.7 


System Data Symbol Rate (kBd) 


117.9 



Table I; Generic system parameters using the Frames spread speech/data mode 2 proposal [11] 



The associated parameters will be addressed in more depth during our farther discourse. Employing 

234 a low spreading factor of 16 allowed us to improve the system's multi-user performance with the aid 

235 of joint-detection techniques [21]. We note furthermore that the implementation of the joint detection 
2M receivers is independent of the number of bits per symbol associated with the modulation mode used, 

237 since the receiver simply inverts the associated system matrix and invokes a decision concerning the 

238 received symbol, irrespective of how many bits per symbol were used. Therefore, joint detection 

239 receivers are amenable to amalgamation with the above 1, 2 and 4 bit/symbol modem, since they 

240 do not have to be reconfigured each time the modulation mode is switched, 

241 In this performance study we used the Pan-European FRAMES proposal [1 1] as the basis for our CDMA 
2« system. The associated transmission frame structure is shown in Figure 3, while a range of generic system 
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Features 


| BCH coding 


Turbo coding 


Modulation 


4QAM 


Transmission bitrate (kbit/s) 


29.5 


Video-rate (kbit/s) 


13.7 


11. 1 


Video framerate (Hz) j 


10 



Table 2: FEC-protected and unprotected BCH and Turbo coded bitrates for the 4QAM transceiver mode 

2« parameters are summarised in Table 1. In our performance studies we used the COST207 seven-path bad 

244 urban (BU) channel model, whose impulse response is portrayed in Figure 4. 

2*$ Our initial experiments compared the performance of a whitening matched filter (WMF) for single user 
detection and the Minimum mean square error block decision feedback equalizer (MMSE-BDFE) for 

!47 joint multi-user detection. These simulations were performed using 4-level Quadrature Amplitude Mod- 

2« ulation (4QAM), transmitting both binary BCH and turbo coded video packets. The associated bitrates 

249 are summarised in Table 2. 

2$o The transmission bitrate of the 4QAM modem mode was 29.5Kbps, which was reduced due to the ap- 

25i proximately half-rate BCH or turbo coding, plus the associated video packet acknowledgement feedback 

2$2 flag error control and video packetisation overhead to produce effective video bitrates of 13.7Kbps and 

253 11. 1Kbps, respectively. A more detailed discussion on the video packet acknowledgement feedback 

254 error control and video packetisation overhead will be provided in Section 3.4 with reference to the 
ass convolutionally coded multi-mode investigations. 

256 Figure 5 portrays the bit error ratio (BER) performance of the BCH coded video transceiver using both 

257 matched filtering and joint detection for 2-8 users. The bit error ratio is shown to increase, as the number 
of users increases, even upon employing the MMSE-BDFE multi-user detector (MUD). However, while 

259 the matched filtering receiver exhibits an unacceptably high BER for supporting perceptually unimpaired 

h» video communications, the MUD exhibits a far superior BER performance. 

2Bi When the BCH codec was replaced by the turbo-codec, the bit error ratio performance of both matched 

262 filtering and the MUD receiver improved, as shown in Figure 6. However, as expected, matched filtering 

263 was still outperformed by the joint detection scheme for the same number of users. Furthermore, the 

264 matched filtering performance degraded rapidly for more than two users. 

265 Figure 7 shows the video packet loss ratio (PLR) for the turbo coded video stream using matched filtering 

266 and joint detection for 2-8 users. The figure clearly shows that the matched filter was only capable of 

267 meeting the target packet loss ratio of 5% for upto four users, when the channel SNR was in excess of 
26« 1 ldB. However, the joint detection algorithm guaranteed the required video packet loss ratio performance 
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Features 


Multi-rate System 


Mode 


BPSK 


4QAM 


16QAM 


Bits/Symbol 


1 


2 


4 


FEC 


Convolutionai Coding 


Transmitted bits/packet 


204 


408 


816 


Total bitrate (kbit/s) 


14.7 


29.5 


58.9 


FEC-coded bits/packet 


102 


204 


408 


Assigned to FEC-coding (kbit/s) 


7.4 


14.7 


29.5 


Error detection per packet 


16 bit CRC 


Feedback bits / packet 


9 


Video packet size 


77 


179 


383 


Packet header bits 


8 


9 


10 


Video bits/packet 


69 


170 


373 


Unprotected video-rate (kbit/s) 


5.0 


12.3 


26.9 


Video framerate (Hz) 


10 



Table 3: Operational-mode specific transceiver parameters for the proposed multi-mode system 

m» for 2-8 users in the entire range of channel SNRs shown. Furthermore, the 2-user matched-filtered PLR 
aw performance was close to the 8-user MUD PLR. 



m 3.4 Multi-mode Video System Performance 

y Having shown that joint detection can substantially improve our system's performance, we investigated 

J* the performance of a multi-mode convolutionally coded video system employing joint detection, while 

v* supporting two users. The associated convolutionai codec parameters are summarised in Table 3. 

m Below we now detail the video packetisation method employed. The reader is reminded that the number 

m of symbols per TDMA frame was 68 according to Table 1. In the 4QAM mode this would give 136 bits 

*77 per TDMA frame. However, if we transmitted one video packet per TDMA frame, then the packetisation 

™ overhead would absorb a large percentage of the available bitrate. Hence we assembled larger video 

27. packets, thereby reducing the packetisation overhead and arranged for transmitting the contents of a 

*«o video packet over three consecutive TDMA frames, as indicated in Table I. Therefore each protected 
video packet consists of 68 x 3 = 204 modulation symbols, yielding a transmission bitrate of between 

» 14.7 and 38.9 Kbps for BPSK and 16QAM, respectively. However, in order to protect the video data 
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cs3 we employed half-rate, constraint-length nine conventional coding, using octal generator polynomials 

:84 of 561 and 753. The useful video bitrate was further reduced due to the 16-bit Cyclic Redundancy 

sas Checking (CRC) used for error detection and the nine-bit repetition-coded feedback error flag for the 

286 reverse link. This results in video packet sizes of 77, 179 and 383 bits for each of the three modulation 

28? modes. The useful video capacity was finally further reduced by the video packet header of between 8 

288 and 10 bits, resulting in useful or effective video bitrates ranging from 5 to 26.9 Kbps in the BPSK and 

289 1 6QAM modes, respectively. 

290 The proposed multi-mode system can switch amongst the 1, 2 and 4 bit/symbol modulation schemes 
29. under network control, based upon the prevailing channel conditions. As seen in Table 3, when the 

292 channel is benign, the unprotected video bitrate will be approximately 26.9Kbps the 16QAM mode. 

293 However, as the channel quality degrades, the modem will switch to the BPSK mode of operation, where 
j4 the video bitrate drops to 5Kbps, and for maintaining a reasonable video quality, the video resolution has 
«5 to be reduced to SQCIF ( 1 28x96 pels). 

29« Figure 8 portrays the packet loss ratio for the multi-mode system, in each of its modulation modes for a 

297 range of channel SNRs. It can be seen in the figure that above a channel SNR of l4dB the 16QAM mode 

298 offers an acceptable packet loss ratio of less than 5%, while providing an unprotected video rate of about 

299 26.9Kbps. If the channel SNR drops below !4dB, the multi-mode system is switched to 4QAM and 

300 eventually to BPSK, when the channel SNR is below 9dB, in order to maintain the required quality of 
mi service, which is dictated by the packet loss ratio. The figure also shows the acknowledgement feedback 
302 error ratio (FBER) for a range of channel SNRs, which has to be substantially lower, than the video 
»3 PLR itself. This requirement is satisfied in the figure, since the feedback errors only occur at extremely 
304 low channel SNRs, where the packet loss ratio is approximately 50%, and it is therefore assumed that 
a the multi-mode system would have switched to a more robust modulation mode, before the feedback 

3oe acknowledgement flag can become corrupted. 

so? The video quality is commonly measured in terms of the peak-signal-to-noise-ratio (PSNR). Figure 9 

3o« shows the video quality in terms of the PSNR versus the channel SNRs for each of the modulation 

309 modes. As expected, the higher throughput bitrate of the 16QAM mode provides a better video quality. 

3to However, as the channel quality degrades, the video quality of the 16QAM mode is reduced and hence 

3m it becomes beneficial to switch from the 16QAM mode to 4QAM at an SNR of about 14dB, as it was 

312 suggested by the packet loss ratio performance of Figure 8. Although the video quality expressed in 

313 terms of PSNR is superior for the 16QAM mode in comparison to the 4QAM mode at channel SNRs 
3M in excess of !2dB, however, due to the excessive PLR the perceived video quality appears inferior in 
3i$ comparison to that of the 4QAM mode, even though the 16QAM PSNR is higher for channel SNRs 
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ate in the range of l2-l4dB. More specifically, we found that it was beneficial to switch to a more robust 

a«7 modulation scheme, when the PSNR was reduced by about IdB with respect to its unimpaired PSNR 

318 value. This ensured that the packet losses did not become subjectively apparent, resulting in a higher 

319 perceived video quality and smoother degradation, as the channel quality deteriorated. 

320 The effect of packet losses on the video quality quantified in terms of PSNR is portrayed in Figure 10. 

321 The figure shows, how the video quality degrades, as the PLR increases. It has been found that in order 

322 to ensure a seamless degradation of video quality as the channel SNR reduced, it was the best policy 

323 to switch to a more robust modulation scheme, when the PLR exceeded 5%. The figure clearly shows 
32« that a 5% packet loss ratio results in a loss of PSNR, when switching to a more robust modulation 
32$ scheme. However, if the system did not switch until the PSNR of the more robust modulation mode 
32« was similar, the perceived video quality associated with the originally higher rate, but channel-impaired 
m stream became inferior. 

328 3.5 Burst-by-Burst adaptive videophone system 

329 A burst-by-burst adaptive modem, maximizes the system's throughtput by using the most appropriate 

330 modulation mode for the current instantaneous channel conditions. Figure 1 1 exemplifies, how a burst- 

331 by-burst adaptive modem changes its modulation modes based on the fluctuating channel conditions. The 

332 adaptive modem uses the SINR estimate at the output of the joint-detector to estimate the instantaneous 

333 channel quaJity, and hence to set the modulation mode. 

334 The probability of the adaptive modem using each modulation mode for a particular channel SNRs is 

335 portrayed in Figure 12. It can be seen at high channel SNRs that the modem mainly uses the 16QAM 
338 modulation mode, while at low channel SNRs the BPSK mode is most prevalent 

.137 The advantage of dynamically reconfigured burst-by-adaptive modem over the statically switched multi- 

33a mode system previously described, is that the video quality is smoothly degraded as the channel condi- 

3» tions deteriorate. The switched multi-mode system results in more sudden reductions in video quality, 

340 when the modem switches to a more robust modulation mode. Figure 13 shows the throughput bitrate 

341 of the dynamically reconfigured burst-by-burst adaptive modem, compared to the three modes of the 

342 statically switched multi-mode system. The reduction of the fixed modem modes' effective throughput 

343 at low SNRs is due to the fact that under such channel conditions an increased fraction of the transmitted 

344 packets have to be dropped, reducing the effective throughtput. The figure shows the smooth reduction of 

345 the throughput bitrate, as the channel quality deteriorates. The burst-by-burst modem matches the BPSK 
348 mode's bitrate at low channel SNRs, and the 16QAM mode's bitrate at high SNRs. The dynamically 
347 reconfigured burst-by-burst adaptive modem characterised in the figure perfectly estimates the prevalent 
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channel conditions although in practice the estimate of channel quality is not perfect and it is inherently 

■u* delayed. However, we have found that non-perfect channel estimates result in only slightly reduced 

3so performance, when compared to perfect channel estimation. 

3s» The smoothly varying throughput bitrate of the burst-by-burst adaptive modem translates into a smoothly 

352 varying video quality as the channel conditions change. The video quality measured in terms of the 

353 average peak signal to noise ratio (PSNR) is shown versus the channel SNR in Figure 14 in contrast to 

354 that of the individual modem modes. The figure demonstrates that the burst-by-burst adaptive modem 

355 provides equal or better video quality over a large proportion of the SNR range shown than the individual 
3s« modes. However, even at channel SNRs, where the adaptive modem has a slightly reduced PSNR, the 
357 perceived video quality of the adaptive modem is better since the video packet loss rate is far lower, than 
35t that of the fixed modem modes. 

.9 Figure 15 shows the video packet loss ratio versus channel SNR for the three fixed modulation modes 

3«o and the burst-by-burst adaptive modem with perfect channel estimation. Again the figure demonstrates 

3«» that the video packet loss ratio of the adaptive modem is similar to that of the fixed BPSK modem mode, 

sea however the adaptive modem has a far higher bitrate throughput, as the channel SNR increases. The 

383 burst-by-burst adaptive modem gives an error performance similar to that of the BPSK mode, but with 

3«4 the flexibity to increase the bitrate throughput of the modem, when the channel conditions improve. If 

385 imperfect channel estimation is used, the throughput bitrate of the adaptive modem is reduced slightly, 

sea Furthermore, the video packet loss ratio seen in Figure 15 is slightly higher for the AQAM scheme due 

367 to invoking higher-order modem modes, as the channel quality increases. However we have found that 

3«6 is possible to maintain the video packet loss ratio within tolerable limits for the range of channel SNRs 

389 considered. 

o The interaction between the video quality measured in terms of PSNR and the video packet loss ratio 

an can be more clearly seen in Figure 16. The figure shows that the adaptive modem slowly degrades 

an the decoded video quality from that of the error free 16QAM fixed modulation mode, as the channel 

373 conditions deteriorate. The video quality degrades from the error-free 4ldB PSNR, while maintaining a 

374 near-zero video packet loss ratio, until the PSNR drops below about 36dB PSNR. At this point the further 

375 reduced channel quality inflicts an increased video packet loss rate and the video quality degrades more 
378 slowly. The PSNR versus packet loss ratio performance then tends toward that achieved by the fixed 

377 BPSK modulation mode. However the adaptive modem achieved better video quality than the fixed 

378 BPSK modem even at high packet loss rates. 
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370 3.6 Summary 

aw A joint-detection assisted multimode CDMA-based video transceiver was proposed, which substantially 

u\ outperformed the conventional matched-filtering based transceiver, which was characterised by adap- 

iez tively reconfiguring the transceiver's mode of operation based on the instantaneous channel quality. In 

383 our transceiver a higher number of bits per modulation symbol was invoked by the transmitter, when 

384 the channel quality was sufficiently high for supporting this more bitrate efficient, but less error resilient 

385 transmission mode. By contrast, a more error resilient but less bitrate efficient mode was invoked for 
sse supporting error-free CDMA transmission over wireless multi-user channels. 

387 In this embodiment the above property was exploited in a practical adaptive video transceiver, which 

388 instructed the video codec to generate the required number of bits that the CDMA transceiver was capable 
3w of delivering in its current channel-condition dependent configuration mode. 

3«o In other embodiments the proposed burst-by-burst adaptive transceiver can be invoked in the context 

391 of arbitrary multimedia signals, irrespective of their resolution or source representation quality. Spe- 

38* cific further embodiments of such codecs are constituted by programmable-rate speech, audio, video, 

393 handwriting codecs, which can be configured by the transceiver to generate a channel-quality dependent 

so* number of source-coded bits. 

395 The proposed burst-by-burst adaptive video transceiver guaranteed a near-unimpaired video quality for 

398 channel SNRs in excess of about 5 dB over the COST207 dispersive Rayleigh-faded channel. The ben- 

397 efits of the multimode video transceiver clearly manifest themselves in terms of supporting un-impaired 

398 video quality under time-variant channel conditions, where a single-mode transceiver's quality would 

399 become severely degraded by channel effects. The dynamically reconfigured burst-by-burst adaptive 

400 modem gave better perceived video quality due to its more graceful reduction in video quality, as the 
;„<oi channel conditions degraded, than a statically switched multi-mode system. 
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CLAIMS 

1. A method for CDMA transmission of a multimedia signal over a transmission 

medium, the method comprising: 

providing a transmitter operable to transmit in a plurality of modulation modes 
5 varying in bit rate and error resilience between a highest bit rate, lowest error 

resilience mode and a lowest bit rate, highest error resilience mode; 

obtaining a channel quality measure for current transmission; and 

switching to a more or less error resilient modulation mode each time the 

channel quality measure respectively degrades or improves by a defined amount, 
10 whereby multimedia signal quality varies smoothly with varying channel quality of the 

transmission medium. 



2. A method according to claim I, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

15 

3. A method according to claim 2, wherein the defined amount is set with 
reference to an unimpaired signal-to-noise value. 

4. A method according to claim 2 or 3, wherein the signal-to-noise value is a peak 
20 signal-to-noise ratio for a multimedia video signal. 

5. A method according to claim 2 or 3, wherein the signal-to-noise value is a 
segmental signal-to-noise ratio for a multimedia speech signal. 

25 6. A method according to claim 1, wherein the channel quality measure is a 
packet loss value. 

7. A method according to claim 1, wherein the packet loss value is varied 
dependent upon desired multimedia signal quality. 

30 
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8. A method according to claim I, wherein the channel quality measure is a bit 
error rate, 

9. A method according to any one of claims 1 to 8, wherein the channel quality 
5 measure is based on monitoring signal integrity at a remote receiver. 

10. A method according to any one of claims 1 to 8, wherein the channel quality 
measure is based on monitoring signal integrity at a receiver local to the transmitter. 

10 11. A transmitter for transmission of a multimedia source signal over a 
transmission medium to a remote receiver, the transmitter comprising a CDMA 
modem having an output for transmitting a multimedia source signal and an input for 
receiving a channel quality measure for current transmission, wherein the CDMA 
modem is switchable between a plurality of modulation modes varying in bit rate and 

1 5 error resilience between a highest bit rate, lowest error resilience mode and a lowest bit 
rate, highest error resilience mode, such that the CDMA modem is switched to a more 
or less error resilient modulation mode each time the channel quality measure 
respectively degrades or improves by a defined amount, whereby multimedia signal 
quality is smoothly variable with varying channel quality of the transmission medium. 

20 

12. A transmitter according to claim 11, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

13. A transmitter according to claim 12, wherein the defined amount is set with 
25 reference to an unimpaired signal-to-noise value. 

14. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a peak signal-to-noise ratio for a multimedia video signal. 

30 15. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a segmental signal-to-noise ratio for a multimedia speech signal. 
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16. A transmitter according to claim 1 1, wherein the channel quality measure is a 
packet loss value. 

17. A transmitter according to claim 11, wherein the packet loss value is variable 
5 dependent upon desired multimedia signal quality. 

18. A transmitter according to claim 11, wherein the channel quality measure is a 
bit error rate. 

10 19. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a remote receiver. 

20. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a receiver local to the 

15 transmitter. 

21. A transmission system for transmission of multimedia source signals over a 
transmission medium, the system comprising: 

a first transceiver including a local receiver and a local transmitter according to 
20 any one of claims 1 1 to 20; and 

a second transceiver including a remote receiver and a remote transmitter 
according to any one of claims 1 1 to 20. 
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